NON-PERTURBATIVE APPROACH TO RANDOM 
WALK IN MARKOVIAN ENVIRONMENT. 
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Abstract. We prove the CLT for a random walk in a dynamical 
environment where the states of the environment at different sites 
are independent Markov chains. 



1. Introduction 

The study of random walk in random evolving environment has at- 
tracted much attention lately. The basic idea is that, due to the time 
mixing properties of the environment, the CLT should hold in any di- 
mension. Many results have been obtained in the case of transition 
probabilities close to constant ([5, 3, 4, 14, 11, 2, 7] etc) but there are 
still two open problems. On one hand one would like to consider envi- 
ronments with weaker mixing properties (some results in this direction 
have been obtained in [6, 7, 8]). On the other hand one would like to 
understand the case in which the dependence on the environment is not 
small. The present paper addresses the second issue presenting a new, 
non-perturbative, approach to random walks in evolving environment. 

To make the presentation as transparent as possible we consider a 
very simple environment: at each site of Z d we have a finite state 
Markov chain and the chains at different sites are independent. How- 
ever, the present argument applies to the situation where the evolution 
of each site is described by a Gibbs measure. In fact our approach relies 
on the fact that the environment seen from the particle is Gibbsian. 
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We hope that this fact can be established for a wide class of mixing 
environments and so it will be useful for the first problem as well. 

More precisely, at each site u E l* d consider a Markov chain {x™}„, g n 
with the state space A and transition matrix p a b > for any a and 
b. The chains at different sites are independent. Let p a b{k) denote the 
k step transition probability and 7r a denote the stationary distribution 
corresponding to p a b- Let A be a finite subset of Z d . For each a £ A let 
q a>v be a probability distribution on A. Consider a random walk S n such 
that S = and S n+ i = S n + v n with probability q x n v . Let P denote 

the measure of the resulting Markov process on 

when the environment is started with the stationary measure 1 and the 
walk starts from zero. We use E to denote the associated expectation. 

Theorem 1. For each d £ N and random walk P as above, 
(a) there exists v £ M. d and a d x d matrix E > such that 



That is, S n satisfies an averaged (annealed) Central Limit Theorem. 

(b) S > unless there exists a proper affine subspace U C M. d such that 
for all a £ A we have q ajZ = for z £" II. 

(c) If X > then S n satisfies the quenched Central Limit Theorem, 
that is for almost every realization of {x™} the distribution of Sn ^ v 
conditioned on {x"} converges to A/"(0,E 2 ). 

Remark 1.1. Note that the conditions p a b > and the independence 
of the Markov chains at each site can be easily weakened. In fact, one 
can consider an irreducible Markov chain for which such a condition 
is verified only for time n transition matrix p a b(n) and/or a situation 
in which the chains are independent only if at a distance L. Then 
essentially the same proof goes through. 2 To consider more general 
environments, more work is needed. 



In fact our main result holds if the environment is started from any initial 
measure and the proof requires very little change. We assume that the initial 
measure is stationary since this allows us to simplify the notation a little. 

2 In the following just look at the system each time n and keep track of all the 
sites that are at a distance less then L from the sites that the walk can visit in such 
a time. 



lim -E(S n ) = v 
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2. GlBBS MEASURES. 

Here we collect the information about one dimensional Gibbs mea- 
sures used in our proof. The reader is referred to [13] for more infor- 
mation and physics background. Let B be a finite alphabet and B be a 
Card(i3) x Card(i3) matrix (usually called adjacency matrix) whose en- 
tries are zeroes and ones. Let Q + C B N be the space of forward infinite 
sequences to = {ujj}^L such that M l/JjU j :j+1 = 1 for all j (the sequences 
satisfying the last condition are called admissible) . Likewise we let Q 
and Q~ be the spaces of biinfinite and backward infinite admissible 
sequences respectively (in Q~ the indices run from — oo to 0). 

Given 9 G (0, 1) we can define distances dg on Q, Q + and Q~ by 

d${u)' ', to") = 6 where k = max{j : uj\ = u" for |z| < j}. 

We let Cg(Q + ) (respectively Cg(Q), Cg(Q~)) denote the space of dg- 
Lipshitz functions Q + — > M. 3 We say that a function is Holder if it 
belongs to Cg for some 9. Let r be the shift map (ru)i = cui+i- A 
r-invariant measure /i + on Q + is called Gibbs measure with Holder 
potential if 

(2.1) 0(0 = ln^ + ({a; = £o}ki = £i ■■ -W* = £»■•■ ) 

is Holder. That is the conditional probability to see a given symbol at 
the beginning of the sequence depends weakly on the remote future. 
The function cf> given by (2.1) is called the potential of [i + . In this paper 
we shall use the phrase 'Gibbs measure' to mean Gibbs measure with 
Holder potential. The Gibbs measures for Q~ are defined similarly. 

If \x is a r-invariant measure on Q we let /i + and [i~ be its projections 
(marginals) to f2 + and Q~ respectively. Observe that each element of 
this triple determines the other two uniquely. For example given /i + 
we can recover \x using that, for each k, m £ Z, k + m > 0, 

fJ,({co G Q : u>i = — m < i < k}) = h + ({uj G Vt + : iOi — ^,0 < i < k+m}). 

We will call \i the natural extension of 

Proposition 2.1 (Variational Principle). ([10, Theorem 3.5}) The 
following are equivalent 

(a) /x + is a Gibbs measure 

(b) is a Gibbs measure 



3 Note that Cg(fl + ) is a Banach space when equipped with the norm 

lml „ := | /u+ sup \M > : /K)l , 

where |/|oo = sup w<en+ |/(w')|. The analogous fact holds for Cg(f2~) and C$(Sl). 
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(c) There is a Holder function ip : Q — > R such that 

+ h(fi) = sup (v(i>) + h(v)) 

where h denotes the entropy and the supremum is taken over all 
T-invariant measures. 

We will call the measures on Q satisfying the conditions of the above 
proposition Gibbs measures. 

If G Cg(Q~) we consider transfer operator on Cg(Q~) given by 

(2.2) (C+g){u)= e^g{w). 

Proposition 2.2. ([10, Theorem 2.2}) Assume 9 £ (0, 1), (f> £ C e {Qr) 
and 

(2.3) £,(1) = 1. 
Then, 

(a) |£^(#)|oc < \g\oo- 

(b) (Ruelle-Perron-Frobenius Theorem/ 1 There exist constants C > 
0, 7 < 1 such that 

C^ = Q + V 

where QV = VQ = 0, ||Q n || e < G*f and V{g) = (i~(g)l where 
[i~ is the Gibbs measure with potential <fi. 5 In particular, for each 
geCe{n-), 

\C; g - /i-^lU < \\Clg - ii-{g)l\\ e < C-y n \\g\\ e . 

The next result is a combination of [10, Theorem 4.13 and Proposi- 
tion 4.12] and [9, section 4.2a] (see also [1, section 3.6], [15]). 

Proposition 2.3 (CLT in the sense of Renyi). Let fi + be a Gibbs 
measure and v + be a measure absolutely continuous with respect to 
Let g be Holder and denote G n (uj) = X^=o fi , ( r "' a; ) where u is distributed 
according to v + . 

(a) G "-^ +(g) ^A/~(0,a 2 ) wherea 2 = f i+(g 2 )+2Z7 =1 ^(g-9°T3). 

(b) a 2 = iff ' \ G n — nfi + (g)l\ OQ is uniformly bounded. 

4 In fact the Ruelle-Perron-Frobenius Theorem has a more general version where 
the condition (2.3) is not required. However that formulation is more complicated 
and since we are going to apply this theorem in case <p is the log of conditional 
probability (see (2.1)) the version given by Proposition 2.2 is sufficient for our 
purposes. 

5 Given any linear operator A : Co(£l~) — ► Ce(Cl~) we define, as usual, \\A\\e ■= 
su P||/|| e =i \\Af\\e- 
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3. Local environment as seen from the particle 

To prove Theorem 1 we consider the history u of the local environ- 
ment as seen from the particle. 6 More precisely u n is a pair (xg ,v n ). 
Let + be the set of all possible histories. Thus Q + is a space of for- 
ward infinite sequences. Let B = {(a, v) G A x A : q a>v > 0} be the 
alphabet for Q (in our simple case the adjacency matrix is given by 
^>( a ',v'),(a",v") = 1) i-e. we have the full shift) and consider the spaces 
f2 and Q~~ defined in Section 2. We shall use the notation IP+ for the 
measure induced by P on Q + . 7 

Let Tk denote the a- algebra generated by loo, . . . u^. 

Lemma 3.1. There exists a shift invariant measure [i on Q and 7 G 
(0, 1) such that for any k G N there is a constant Ck such that for any 
n,m G N, and any Tk measurable function f we have 

|E(/°T™| F m )-Kf)\<Ck\f\ooi n - m . 

In addition, \x is a Gibbs measure. 

Finally, P + is absolutely continuous with respect to fi + . 

Proof of Lemma 3.1. Note that the case m > n + k is trivially true, we 
then restrict to m < n + k. 

For £ G Q~ , with & = (z;, Vi), and n G N let 

e m = I Pzi,zo(~ l ) ■ Qzov if I = 1(0 ^ -00 
r 20 ■ q zovo if 1(0 = -00 

iPzuz (-l) - Qzovo if I = 1(0 > ~n 



(3.1) 



e 



'zo Hzovo 



if 1(0 < -n 



where 1(0 is the last time before such that Si := Yl,ili v i = 0- 8 We 
have 

(3.2) |0 n - 0|oo = O (A n ) 

where A is the second eigenvalue of p a b- In fact 0(0 = </>n(0 unless 
1(0 < —n in which case the distribution of p zm (— I) is (9(A n )-close 

to 7T.„. 



That is, we record only the environment at the visited sites, contrary to the 
usual strategy of considering all the environment. 

"Indeed, the map : fi — > Cl + defined by ^((x n , S n )neN) = (x"g , S n +i ~ S n )n£N 
is measurable and onto. Thus P + (A) := P(\P _1 (A)). With a slight abuse of notation 
we will use E also for the expectation with respect to P + . 

8 In other words we extend S n to negative n using £j with negative indices and 
look at the last negative time when the walk visits zero. 
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Recall (2.2) and consider the following transfer operators £ := 
£ n := £ ( f >n . Note that £ n l = £1 = 1 and that (3.2) implies that there 
exists C > such that, for all continuous g : Q~ — > K, 

(3.3) \£g - Cngloo < CT%U. 

Next, chose £* G Q~ and for each 6 G £>, m G N, u/ m = (o>o, • • • , w m ) G 
£> m let £*u m b G be the concatenation of £*, a;" 1 and 6. 9 Then 

P({u; m+1 = 6}|.F m )(^o, • • • ,w m ) = exp (0 m+1 (<fw m fr)) • 

By hypotheses there exists / : i3 fc+1 — > R such that /(a;) = /(wo, . . . , k>fc) 
Observe that if g : f2 + — > K. is a JF m+1 measurable function, then 

(3.4) E(g\J 7 m )(u , . . .,u m ) = ^P({ = 6}|J r m )fi'(a;o, • • -,uj m ,b). 

beB 

Therefore for each I G {0, . . . , n + k — m} we have 

(3.5) E(/ o r n | F m )(cu m ) = (£ m+1 ■ ■■C n+ J k )(Cu m ), 
where, for £ G Q~ , we define = ■ ■ ■ , £o)- Hence, by (3.3), 

(3.6) E(/ o r n | F m )(u m ) = £ m ■ ■ ■ £ n+k -i£ l f k + 0(A" +fc -'|/|oo). 

Next, the Ruelle-Perron-Frobenius Theorem (Proposition 2.2(b)) for £ 
and the fact that £1 = 1 imply that there are a Gibbs measure \i~ on 
Q~ , and numbers 0,7 G (0, 1), 7 > 9, such that 

E(/ o r n I J- m ) = £ m+1 • • • £ n+k -d ■ fi-(f k ) + 0(X n+k ~ l + )|/U. 

Choosing / = (which is smaller than n + k — m by hypotheses) 
and 7 2 = max{A, 7} we obtain 

E(/ o r n I T m ) = /i-(A) + 0(C fc7 "— )|/U. 

Since fi~ is Gibbs, Proposition 2.1 implies that fi and fi + are Gibbs. 

To prove the absolute continuity note that equations (3.5), (3.3) 
imply for / > and T k measurable 10 

E(/ I *b)(&) = inf £1 • ■ ■ Cj k (tb) = inf ^ '"fif^ ^A^) 
£en- £en- £ k f k (&) 

< C inf £*/ fc (£&) < C ^ (1 /; o=fe}£ "{ fc) < CV + (/). 
Sen- yU"({^o = &}) 

Thus E(/) < C"/i + (/), which implies the absolute continuity. □ 



9 Essentially £* corresponds to the choice of a 'standard past' for any finite 
sequence. 

10 The first equality follows by the freedom in the choice of £*, the last is true 
because b can take only finitely many values and so inf;, /j,~({u>a = b}) > 0. 
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4. Proof of Theorem 1 

Proof. Part (a) follows from Proposition 2.3(a) and Lemma 3.1. 

Next we analyze the possibility that there exists w G lR d such that 
Y?w = 0. In this case Proposition 2.3(b) implies that (S n , w) is uni- 
formly bounded. Now, suppose there exist pairs (ai,Vi) and (02,^2) 
such that q aj>Vj > and (v u w) ^ (v 2 ,w). Let = {io J k }f =0 , j — 1,2 
where = (aj,Vj). Then (S n ,w) cannot be bounded along both the 
orbits defined by the sequences £W and ^ 2 ^. This proves (b). 

The quenched CLT was derived from the annealed CLT in [7, sections 
3.2 and 3.3] under the assumption that q a>v was weakly dependent on 
a. However this assumption was not used in this part of [7]. Indeed 
what we need to prove in order to conclude the proof of the present 
theorem is the equivalent of Theorem 1 in [7]. The proof of such a 
theorem relies only on the mixing of the environment as seen from the 
particle (our Lemma 3.1) 11 and the estimate [7, (2.21)]. In turn [7, 
(2.21)] follows from [7, Lemma 3.2] by a general argument that uses 
only the mixing property of the process (in our case implied by Lemma 
3.1) and Assumption (A4) of [7] that, in our case, can be replaced by 
the stronger property 

Let S' n and be two independent walkers moving in the same envi- 
ronment. Then conditioned on the event 



{dist (S' N , S'x) > m} 



the increments of S' k and S' k ' are independent for k G (iV, N + c ™ st ) . 
(This holds in our case since the chains at different sites are indepen- 
dent.) 

Finally, [7, Lemma 3.2] follows from [7, Lemma 3.3]. The only prop- 
erty used in such a derivation is that for any m there exists iV such 
that 5" and S" can get m units apart during the time iV with positive 
probability (in our case this follows under the hypothesis that ensure 
Theorem 1(b)). Such a fact also suffices for the proof of the analogue 
of [7, Lemma 3.4] and for the derivation of [7, Lemma 3.3] from [7, 
Lemma 3.4] in the present context. 

In conclusion, the proof carries to the present setting without any 
substantial changes. □ 



In fact, the process determined by the point of view of the particle is different 
here from the one used in [7], as already remarked. Yet, in both cases the walk is 
an additive functional of such a process and the same arguments apply. 



8 



DMITRY DOLGOPYAT AND CARLANGELO LIVERANI 



References 

[1] Aaronson J., An introduction to infinite ergodic theory Mathematical Surveys 
and Monographs, 50. American Mathematical Society, Providence, RI, 1997. 

[2] Bandyopadhyay A., Zeitouni, O., Random Walk in Dynamic Markovian Ran- 
dom Environment, ALEA 1 (2006) 205-224. 

[3] Boldrighini C, Minlos R.A., Pellegrinotti A., Random walks in quenched i.i.d. 
space-time random environment are always a.s. diffusive. Probab. Theory Re- 
lated Fields 129 (2004), no. 1, 133-156. 

[4] Boldrighini C, Minlos R.A., Pellegrinotti A., Random walk in random (fluc- 
tuating) environment Russian Math Surveys 62 (2007) 663-712. 

[5] Bolthauscn E., Sznitman A.-S., On the static and dynamic points of view for 
certain random walks in random environment, Methods Appl. Anal., 9, 3, 
345-375 (2002). 

[6] Comets F., Zeitouni O., Gaussian fluctuations for random walks in random 

mixing environments, Israel J. Math. 148 (2005), 87-113. 
[7] Dolgopyat D., Keller G., Liverani C, Random Walk in Markovian Environ- 
ment, Annals of Probability 36 (2008) 1676-1710. 
[8] Dolgopyat D., Liverani C, Random Walk in Deterministically Changing En- 
vironment, ALEA 4 (2008) 89-116. 
[9] Eaglcson G. K., Some simple conditions for limit theorems to be mixing. (Rus- 
sian) Tcor. Vcrojatnost. i Primenen. 21 (1976), no. 3, 653-660. (Engligh trans- 
lation: Thcor. Prob. Appl. 21 (1976) 637-642, 1977.) 
[10] Parry W., Pollicott M., Zeta functions and the periodic orbit structure of hy- 
perbolic dynamics, Asterisque, 187—188 (1990) 268 pp. 
[11] Rassoul-Agha F., Seppalainen T., An almost sure invariance principle for ran- 
dom walks in a space-time i.i.d. random environment, Prob. Th., Related 
Fields 133 (2005) 299-314. 
[12] Renyi A., On mixing sequences of sets, Acta math. Acad. Sci. Hungar. 9 (1958). 
[13] Ruelle D., Statistical mechanics. Rigorous results. Reprint of the 1989 edition. 
World Scientific Publishing Co., Inc., River Edge, NJ; Imperial College Press, 
London, 1999. 

[14] Stannat W., A remark on the CLT for random walks in a random environment, 
Probability Theory and Related Fields, 130,3, 377-387 (2004). 

[15] Zweimullcr R., Mixing limit theorems for ergodic transformations, Journal of 
Theoretical Probability 20 (2007), 1059-1071. 

Dmitry Dolgopyat, Department of Mathematics, University of Mary- 
land, 4417 Mathematics Bldg, College Park, MD 20742, USA 
E-mail address: dmitry@math.umd.edu 
URL: http : //www . math . umd . edu/~ dmitry 

carlangelo llverani, dlpartimento di matematica, ii universita di 
Roma (Tor Vergata), Via della Ricerca Scientifica, 00133 Roma, Italy. 
E-mail address: liverani@mat.uniroma2.it 
URL: http : //www. mat . uniroma2 . it/" liverani 



